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Abstract — In this paper, joint transceiver design for dual-hop 
amplify-and-forward (AF) MIMO relay systems with Gaussian 
distributed channel estimation errors in both two hops is investi- 
gated. Due to the fact that various linear transceiver designs can 
be transformed to a weighted linear minimum mean-square-error 
(LMMSE) transceiver design with specific weighting matrices, 
weighted mean square error (MSE) is chosen as the performance 
metric. Precoder matrix at source, forwarding matrix at relay 
and equalizer matrix at destination are jointly designed with 
channel estimation errors taken care of by Bayesian philosophy. 
Several existing algorithms are found to be special cases of the 
proposed solution. The performance advantage of the proposed 
robust design is demonstrated by the simulation results. 

I. Introduction 

By deploying relays, cooperative communication has great 
potential to improve system performance |fl~). Among various 
relaying strategies, amplify-and-forward (AF) scheme is at- 
tractive for practical implementation due to its low complexity. 
On other hand, it is well-established that employing multiple 
antennas is beneficial to improve wireless system performance 
due to spatial diversity and multiplexing gains. Consequently, 
in order to obtain the virtues of these two techniques, combina- 
tion of AF transmission and multi-input multi-output (MIMO) 
systems attracts more and more researchers' interest. 

Linear transceiver design for AF MIMO relay systems has 
been widely researched in Q-Q. Unfortunately, most of 
the existing works assume channel state information (CSI) 
is perfectly known. However channel estimation errors are 
inevitable in practical systems. Robust design, which takes 
channel estimation errors into account, is therefore desirable 
in practice. Joint robust design of relay forwarding matrix and 
destination equalizer under channel estimation errors has been 
considered in JTJ. However in Q, source precoder design, 
which provides further degree of freedom for improving 
system performance, is not considered. In this paper, we 
take a step further to jointly design source precoder matrix, 
relay forwarding matrix and destination equalizer mattix under 
channel estimation errors. Q 

There are two main kinds of criteria for transceiver de- 
sign: capacity maximization and mean-square-error (MSE) 
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minimization. In fact, both kinds of criteria can be formu- 
lated as weighted MSE minimization problems (8). Therefore, 
weighted MSE is chosen as the objective function in this paper. 

In this paper, the channel estimation errors are assumed to 
be Gaussian distributed, which is generally true when linear 
channel estimation algorithms are adopted |9|. The structures 
of the optimal solutions for the robust joint transceiver design 
with minimum weighted MSE as the objective are first derived. 
Based on these optimal structures, the transceiver design 
is then significantly simplified and iterative water-filling is 
adopted to solve the problem. Finally, the performance gain 
of the proposed robust design is verified by simulation. 

The following notations are used throughout this paper. 
Boldface lowercase letters denote vectors, while boldface 
uppercase letters denote matrices. The notations Z T , Z* and 
Z H denote the transpose, conjugate and conjugate transpose of 
the matrix Z, respectively and Tr(Z) is the trace of the matrix 
Z. The symbol Im denotes an M x M identity matrix, while 
Om.n denotes an M x N all zero matrix. The notation Z 1 / 2 is 
the Hermitian square root of the positive semi-definite matrix 
Z, such that Z 1 / 2 Z 1/2 = Z and Z 1/2 is also a Hermitian 
matrix. The symbol E denotes statistical expectation. 

II. System Model 
A. Transmitted and Received Signals 

In this paper, a three node dual-hop amplify-and-forward 
(AF) cooperative communication system is considered. In the 
considered system, there is one source with N$ antennas, one 
relay with Mr receive antennas and Nr transmit antennas, 
and one destination with Md antennas. Due to long distance 
and possibly deep fading, the direct link between the source 
and destination is not considered in this paper. At the first hop, 
the source transmits data to the relay. The received signal, x, 
at the relay is 

x = H ar Ps + m (1) 

where H sr is the MIMO channel matrix between the source 
and the relay, and P is the precoder matrix at the source. The 
vector s is the N x 1 data vector transmitted by the source with 
the covariance matrix R s = E{ss H } = Ijy- Furthermore, ni 
is the additive Gaussian noise vector with correlation matrix 

At the relay, the received signal x is multiplied by a 
forwarding matrix F. Then the resultant signal is transmitted 



to the destination. The received signal y at the destination can 
be written as 

y = H rd FH sr Ps + H rd Fm + n 2 , (2) 

where H r d is the MIMO channel matrix between the relay and 
the destination, and ri2 is the additive Gaussian noise vector 
at the second hop with correlation matrix R„ 2 = cr^ 1m d ■ In 
order to guarantee the transmitted data s can be recovered at 
the destination, it is assumed that Ns, Mr, Nr, and Mo are 
greater than or equal to N 12). 

B. Channel Estimation Error Model 

Channel state information is usually estimated via using 
training sequences. In a dual-hop system, there are two chan- 
nels to be estimated. For implementation simplicity, training 
sequences are transmitted from both source and destination 
to the relay. At the relay, the two channels are separately 
estimated and then based on the channel estimates, transceivers 
are jointly designed. After that, the designed transceiver ma- 
trices are forward to the source and destination, respectively. 
In general, two hop channels can be written as 

H sr = H sr + Ssr 2 Hn' 1 sr4'^ 2 , H rd = H r< J + Hw,rd > 
v ' " ✓ ' 

=AH 6 r =AH rd 

(3) 

where H sr and H r ^ are the estimated channels, and AH sr 
and AH r( j are the corresponding channel estimation errors 
whose elements are zero mean Gaussian random variables. 
Furthermore, the Mr x Ns matrix AH sr can be decomposed 
as AH sr = Sg/ 2 Hv7, sr *^ 2 , where the elements of the M R x 
Ns matrix H\v,sr are independent and identically distributed 
(i.i.d.) Gaussian random variables with zero mean and unit 
variance. When MMSE channel estimator is used, the row 
and column covariance matrices of AH sr can be derived as 

m 

£ sr = I Mr , = (ffj£lw s + ^ r D 1 *D?T 1 (4) 

where a\ is channel variance in the first hop and Di is the 
training sequence used in the first hop. Similarly, the row and 
column covariance matrices of AH rt j, can also be derived to 
be 

S rd = (ffj- 2 d lM D + 4-D2D?)- 1 , *? d = I Na (5) 

where a\ denotes the channel variance of the second hop and 
D2 represents the training sequence used in the second hop. 
Notice that the directions of training sequences transmitted in 
the two hops are opposite. Therefore, the results given by (0]i 
and ([5]) are different. 

III. Problem Formulation 

At the destination, a linear equalizer G is adopted to detect 
the data vector s. The mean-square-error (MSE) matrix is 
E{(Gy — s)(Gy — s) H } , where the expectation is taken with 
respect to random data, channel estimation errors, and noise. 
In id, it is shown that 

E{(Gy-s)(Gy-s) H } 

= G(H rd FR x F H H? d + K 2 )G H +I N - (P H Hf r F H H? d G H ) 
(GH rd FH sr P), (6) 



where matrices R x and K2 are defined as 

R x = E{xx H } = H sr PP H fif r + Kj 

Ki = Tr(PP H * sr )S,r + R ni 

K 2 = Tr(FR x F H * rd )£ rd + R„ 2 . (7) 

It is obvious that R x is the covariance matrix of the received 
signal at the relay. Based on the MSE matrix given by ©, a 
more general performance metric for transceiver design is the 
weighted MSE 0: 

MSE W (G, F, P) = E{(Gy - s) H W(Gy - s)} 

= Tr[WE{(Gy-s)(Gy-s) H }], (8) 

where W is a N x N positive semi-definite weighting matrix. 
Under transmit power constraints at the source and relay, the 
optimization problem of transceiver design is formulated as 

PI: min MSE W (G.F,P) 

G,F,P 

s.t. Tr(PP H ) < P s , Tr(FR x F H ) < P r . (9) 

Notice that based on the definition of R x in (O, R x is a 
function of P. In order to simplify the analysis, we define a 
new variable 

F 4 FK} /2 (K- 1/2 H ST .PP H H? r K- 1/2 + Im„) 1/2 , (10) 

v . ' 

=n P 

based on which Tr(FR x F H ) = Tr(FF H ) and the two con- 
straints in the optimization problem Q9j> becomes independent. 
Furthermore, with ( fTOb the objective function becomes 

MSE W (G,F,P) 

=Tr[WG(H rd FF H H? d + K 2 )G H ] 

- Tr(WGH rd Fn; 1/2 K~ 1/2 H B7 .P) 

- Tr(WP H H".K7 1/2 n p 1/2 F H H^ d G H ) + Tr(W). (11) 

As in the optimization problem (O there is no constraint on 
G, the optimal solution for G can therefore be written as a 
function of P and F (7), and is given by 

G = (H rd Fn; 1/2 K 1 - 1/2 H sr P) H (H rd FF H H? d + K2)" 1 . (12) 

Substituting (fT2l) into the MSE formulation (fTTT i. the weighted 
MSE can be rewritten as 

MSE W -(F,P) 

= Tr(W) - Tr[(H rd Fn p 1/2 K7 1/2 H sr PW 1/2 ) H 

x (H rd FF H Hf d + K 2 )- 1 (H rd Fn p 1/2 K- 1/2 H sr PW 1/2 )]. 

(13) 

Finally, it can be easily proved that the optimal P and F must 
occur on the boundary Q 

Tr(PP H ) = P s , Tr(FF H ) = P r . (14) 

Clearly, it means that for the minimum weighted MSE, both 
relay and source should transmit at the maximum power. As 
a result, the optimization problem for joint transceiver design 
is formulated as 

P2 : min MSE W (F,P) 

F,P 

s.t. Tr(FF H ) = P r , Tr(PP H ) = P s . (15) 

In the following, the structures of the optimal solutions are first 
derived and then the transceiver design problem is simplified 
and solved in Section [VT] 



IV. The structure of optimal F 

With 

A 4 (n p 1/2 Kj- 1/2 H sr PW 1/2 ) 
M 4 F H H* d (H rd FF H H* d + K^^H^F, (16) 
the weighted MSE can be further reformulated as 

MSE W (F,P) = Tr(W) - Tr(A H MA). (17) 

Using the matrix inversion lemma, M = I — 
(F H Hj i d K2 1 H rd F + I)" 1 , the weighted MSE further 
becomes 

MSE W (F,P) = Tr(W) - Tr(A H A) 

+ T r [A H (F H H^K 2 - 1 H rd F + Tv/J^A]. (18) 

It should be highlighted that the two constraints in ( flSt are 
independent and for any given P the optimization problem for 
F is equivalent to 

min Tr[A H (F H H? d K 2 - 1 H r[i F + Im^T'A] 

F 

s.t. Tr(FF H ) = P r (19) 

where the constant parts independent of F have been ne- 
glected. With the fact that \If r d = I from (0, we have 

K 2 = Tr(FF H * rd )E rd + al 2 I M » = P^rd + al 2 I M » (20) 

which is a constant matrix. Furthermore, based on singular 
value decomposition 

A = UaA a V a , K 2 1/2 H rd = U rd A rd V ? H d . (21) 

where the diagonal elements of Aa and A r d are in decreasing 
order. Using Majorization theory, the objective function of 
(TT9T l can be transformed into a Schur-concave function of 
the diagonal elements of (U A F H H^K7 1 H rd FU A + Im„)"'. 
Therefore, the optimal solution of (fl9] i has the following 
structure Q 

F = V rd , w A # Ui iJV (22) 
where A* is a N x N diagonal matrix such that the diagonal 

- 2 

elements of A F A rd A F are in decreasing order. The diagonal 
matrix A r( j is the N x N principal submatrix of A r( j. The 
matrices ~V r d,N and Ua,jv are the first N columns of V r( j 
and Ua, respectively. As A is a function of P, the value 
of XJa.n will be given in the next section, after giving the 
structure of optimal P. 

V. The structure of optimal P 

Substitutin g th e structure of optimal F (l22l into the defini- 
tion of M in ( 1 1 6b , and together with the fact that the diagonal 

elements of A F A rd A F are in decreasing order, we have 

M = U A ,iv [In - (AjA^Af + In)' 1 ] U AjJV (23) 

where Am is a N x iV diagonal matrix with diagonal elements 
in decreasing order. It is also straightforward that d23l ) is the 
eigen-decomposition of M. Based on d23l i. and the singular 
value decomposition of A given in (fJTJ, after a straightforward 
substitution we have the following identity 

A H MA = V A A A A M A A V A = V A A M V A A H A (24) 



where Aa is the N x N principal submatrix of Aa and is 
a diagonal matrix with diagonal elements in decreasing order. 
Using ((24b . the weighted MSE given by ( flTt is rewritten as 

MSEV(F,P) = Tr(W) - Tr(A H MA) 

= Tr(W) - Tr(V A Am V A A H A) . (25) 

It is shown in Appendix A that for the minimum MSE the 
following identity holds 

V A = U w , (26) 

where the unitary matrix Uw is obtained from the eigen- 
decomposition of W = UwAwU w in which Aw is a 
diagonal matrix with decreasing diagonal elements. The above 
equation will also be useful in the following derivation. 

From (l26l l and the definition of A in (Tl6i l and using the 
matrix inversion lemma again, the weighted MSE d25b can be 
further rewritten as 

MSEw(F,P) 

=Tt(W) - Tr[(n p 1/2 K7 1/2 H sr P)W 1/2 UwAMU > i,W 1/2 

x (n P 1/2 K- 1/2 H sr p) H ] 

=Tr(W) + Tr[U w A^ 2 A M A^ 2 U^(P H Hf r K 1 : 1 H 3 rP + I) -1 ] 
-Tr(W 1/2 U w A M u5,W 1/2 ). (27) 

Notice that based on the definition of M in JTol l, Am is a 
function of F only and independent of P. Only the second 
term in ( [27] ) is a function of P. Then, the optimization problem 
for P becomes 

mm Tr[U w A^ 2 A M A^ 2 U ; | > ,(P H H5 I r K l : 1 H SI .P + In)' 1 } 

s.t. Tr(PP H ) = P s . (28) 

For source precoder design, the main difference from forward- 
ing matrix F design is that Ki is not constant. As mentioned 
previously S sr = I ©, then Ki equals to 

Kj = [Tr(PP H * sr ) + cr 2 ni ]I MR ± V P hi R - (29) 

With the power constraint Tr(PP H ) = P s , we have 

r ?p = Tr(PP H * sr ) + < 

= Tr(PP H * sr ) + a 2 ni Tr(PP H )/P Sj 

=i 

= Tr(PP H (P s * sr +a 2 1 I iVs ))/P s . (30) 

From d30l l. the constraint of the optimization problem (|281 ) 
becomes as 

Tr(PP H ) = Tr[PP H (P s * ar + a^hfg)]/^ = P., (31) 

based on which the optimization problem (f28b is equivalent 
to 

mm Tr[UwA^ 2 A M A^ 2 U^(P H l/ 7 7 P H^H S rP + In)" 1 ] 
s.t. Tr[PP H (P s * sr + a 2 1 Iiv s )]/77p = Ps. (32) 

Defining a new variable, 

P = l/V%(P s * sr + 4liV s ) 1/2 P 03) 

the optimization problem (|32l becomes as ( [34-b as shown at 
the top of the next page. This formulation is exactly the same 



min TiiU w A^ 2 A M A^ 2 U^(P H (P s * sr +^ 1 I JVs )- 1/2 H^.H sr (P a * sr + ( 7^I J v s )~ 1/2 P + I]v)" 1 ] 
p 

s.t. Tr(PP H ) = P s (34) 



as the optimization problem (T% for F. Following the same 
argument for F and defining unitary matrices JJ sr and V sr 
based on the following singular value decomposition 



H sr (P s * sr + a 2 1 I iVs )- 1/2 = U sr A sr V: 

with the diagonal elements of the diagonal matrix A sr in 
decreasing order, the optimal P has the following structure 

P = V^jvApU^ (36) 

where A p is a N x N diagonal matrix such that the diagonal 

~ 2 

elements of A p A sr A p are in decreasing order. The diagonal 
matrix A sr is the N x N principal submatrix of A sr . Further- 
more, based on the definition of P given by (l33l i, the optimal 
P has the following structure 

P = ^(P s * S r + ^ 1 I A r s ) _1/2 V sr ,i V ApU^. (37) 

Substituting ( |37] i into the definition of A in ( fToT l, we have 
Ua,jv = XJ S r,N- Therefore, the optimal F has the following 



7-H 



(35) 



structure 



F = V r d,ArA F U ST . iiv . 



(38) 



Remark: Given d37l i and d38l l. the remaining problem is how 
to determine two diagonal matrices A F and A p . 

Notice that after A p is computed, the remaining unknown 
parameter in < f37T > is only r) p . In order to solve r] p , substitute 
the formulation of P d371 i into the definition of rj p in d29b , and 
then we get 

T) p = Tr(PP H * sr )+a 2 1 

= Vp Tr{Vf r , N (P a * sr + a 2 zl iy 1/2 * sr (P s * sr + a 2 ni iy 1/2 
x V sr ,ivA|] +o 2 ni . (39) 

This is a simple linear function of rj p , and rj p can be easily 
solved to be 



Vp = - Tr[V? r>iv (P s * sr +<I)" 1/2 *,r 

X (P s * sr + a 2 1 I)- 1/2 V sr ,j V A|]}. 

VI. Proposed Solution for A F and A p 



(40) 



In this section, the optimal A F and A p will be derived. 

Notice that A sr and A r d are the N x N principal submatrices 
of A sr and A r( j, respectively. Based on (l3TT l. substituting the 
optimal structures ( f37T > and (|38l l into the original optimization 
problem (fT5l l, and denoting 

A sr = diag{A s?V! } A rd = diag{A r d,i} A F = diag{/i} 
A p = diag{pi} A w = diag{u>i} (41) 

the optimization problem (Q3) becomes 



min > 



w i(fi ^rd,i +Pi^ar.i + 1) 



N 



N 



i=l i=l 



(42) 



where A a = diag{A a ,i} means that the i th diagonal element 
of the diagonal matrix A a is denoted as \ a ,i- This optimization 
is non-convex, and thus generally speaking it is difficult to 
solve. However, notice that when pj's are fixed, /j's can be 
computed as 



fi 



1/2 



(43) 



where \ij is the Lagrange multiplier which makes ff = Pr- 
On the other hand, when /j's are fixed, p^'s can be computed 



Pi = 



f' 2 \ 2 



1 + / 2 A 2 



1/2 



(44) 



where [i v is the Lagrange multiplier which makes J^Pi = 
P s hold. Notice that this iterative water-filling algorithm is 
guaranteed to converge, as discussed in iflOl . 
Special cases: Several existing algorithms can be considered 
as special cases of our proposed solution. 

• When CSI is perfectly known, W = I and P = I, the 
proposed solution for F reduces to that in J2). 

• When CSI is perfectly known and W = I, the proposed 
solution for P and F reduces to that given in Q. 

• When the second hop channel is an identity matrix and 
noiseless, the proposed solution for source precoder design 
reduces to that given in ifTTI . 

VII. Simulation Results and Discussions 

In this section, simulation results are presented to demon- 
strate the performance of the proposed algorithm. For the 
purpose of comparison, the algorithm based on the estimated 
channel only (without taking the channel errors into account) 
j5) and the robust algorithm without source precoder design 
in are also simulated. In the following, we consider an AF 
MIMO relay system where the source, relay and destination 
are equipped with the same number of antennas, i.e., N$ = 
Mr = Nr = Mb = 4. The elements of channel matrices H sr 
and H r d are randomly generated as i.i.d. Gaussian distributed 
random variables. 

The widely used exponential correlation matrix R Q = 
{a^~^}ij is used to model the correlation matrix of D, i.e., 
DD H oc R Q . Then * sr = "E rd = (I 4 + SNRestRq) -1 
where SNRest is the signal-to-noise ratio (SNR) in channel 
estimation process. In the simulation, the weighting matrix 
is selected as W = diag{[0.3 0.3 0.2 0.2]}. The noise 



covariance matrices are 



crfli and R„ 



&2 I4. In 



data transmission stage the SNRs at relay and destination are 
defined as P s /ai 2 and P r ja\, respectively. 



based on which, the weighted MSE ([T8T l can be rewritten as 




Fig. 1, Weighted MSEs of the detected data for different algorithms, when 
a = 0.3 and P s /°i = p rl<^\ = 30dB. 

For the source node, four independent data streams are 
transmitted and in each data stream, Nnata = 10000 inde- 
pendent QPSK symbols are transmitted. Each point in the 
figure is an average of 10000 independent channel realizations. 
Fig.Q]shows the weighted MSEs at the destination for different 
algorithms when a = 0.3 and P s /af = P r jo\ = 30dB. It 
can be seen that the performance of the proposed algorithm 
is always better than that based on the estimated CSI only. 
It can also be observed that the proposed robust algorithm 
with source precoder design performs better than that without 
source precoder design in Q, illustrating the importance of 
joint transceiver design involving source precoder. 

VIII. Conclusions 

Robust LMMSE transceiver design under Gaussian channel 
uncertainties for dual-hop AF MIMO relay systems was inves- 
tigated. Exploiting channel estimation error statistics and using 
a general weighted MSE performance metric, the precoder 
matrix at the source, forwarding matrix at the relay and equal- 
izer matrix at the destination were jointly optimized. It was 
found that several existing solutions are special cases of our 
proposed solution. The performance advantage of the proposed 
algorithm was demonstrated by the computer simulations. 

Appendix A 

Based on d24l i and the fact that Aa and Am are diagonal 
matrices with diagonal elements in decreasing order, the 
following identity holds 

A H MA = VaAiV^, (45) 

where Ai = AaAmAa is a diagonal matrix with diagonal 
elements in decreasing order. Notice that (l45l l in fact is an 
eigen-decomposition of A H MA with eigenvalues in decreas- 
ing order and Va is the corresponding unitary matrix. 
Defining 

N 4 (H rd Fn p 1/2 K i : 1/2 H i , r P) H (H r[i FF H H? d + Ka)" 1 
x (H rd Fn p 1/2 K- 1/2 H sr P), (46) 

and together with the definitions of A and M in (IT6b the 
following equation holds 

A H MA = W 1/2 NW 1/2 , (47) 



MSE W (F, P) = Tr(W) - Tr(WN) 

> Tr(W) - V A»(W)Ai(N), (48) 

* — *i 

where Aj(Z) denotes the i th largest eigenvalue of Z. Using 
Neumann inequality lTT2l . for the minimum weighted MSE N 
and W have the same eigen- vectors. In other words, given the 
eigen-decomposition of W as 

W = UwAwUS, (49) 

where the diagonal elements of the diagonal matrix Aw are 
in decreasing order, for the minimum MSE, N could be eigen- 
decomposed as 

N = UwAnU^,. (50) 

where An is a diagonal matrix whose diag onal elements are 
in decreasing order. Based on d49b and i50h for the minimum 
MSE it holds that 

A H MA = W 1/2 NW 1/2 = U w A w A N U w . (51) 

=A 2 

As the diagonal elements of the diagonal matrices Aw and 
An are positive and both in decreasing order, the diagonal 
elements of A2 are also in decreasing order. Clearly, the 
second equation of ( BTT ) also denotes an eigen-decomposition 
of A H MA. Comparing d45T > and (I5TI 1. it can be concluded that 
for the minimum MSE there exists an eigen-decomposition of 
A H MA with eigenvalues in decreasing order such that 

V A = U w . (52) 
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